Environment-aware computerized information and display apparatus

ABSTRACT

Computerized apparatus useful for obtaining and displaying information obtained from multiple sources. In one embodiment, the computerized apparatus is part of a transport device or apparatus, and includes a display device and speech recognition apparatus configured to receive user speech input and enable performance of various tasks, such as obtaining desired information relating to an entity, images thereof, maps or directions, or any number of other topics. The apparatus in one variant further includes sensor apparatus in communication with the computerized apparatus, and which enables for example display of data derived from one or more sensors exposed to an environment of the transport device on the display device.

This application is a divisional of and claims priority to co-owned andco-pending U.S. patent application Ser. No. 13/733,098 filed Jan. 2,2013 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS; whichis a continuation of and claims priority to Ser. No. 13/369,850 filedFeb. 9, 2012 and entitled “COMPUTERIZED INFORMATION PRESENTATIONAPPARATUS”, now U.S. Pat. No. 8,447,612; which is a continuation of andclaims priority to co-owned U.S. patent application Ser. No. 12/711,692filed Feb. 24, 2010 and entitled “ADAPTIVE INFORMATION PRESENTATIONAPPARATUS AND METHODS”, now U.S. Pat. No. 8,117,037; which is acontinuation of and claims priority to co-owned U.S. patent applicationSer. No. 11/506,975 filed Aug. 17, 2006 and entitled “SMART ELEVATORSYSTEM AND METHOD”, now U.S. Pat. No. 7,711,565; which is a divisionalof and claims priority to co-owned U.S. patent application Ser. No.10/935,957 filed Sep. 7, 2004 and entitled “SMART ELEVATOR SYSTEM ANDMETHOD”, now U.S. Pat. No. 7,093,693; which is a divisional of co-ownedU.S. patent application Ser. No. 10/651,451 filed Aug. 29, 2003 andentitled “SMART ELEVATOR SYSTEM AND METHOD”, now U.S. Pat. No.6,988,071; which is a continuation of co-owned U.S. patent applicationSer. No. 09/330,101 filed Jun. 10, 1999 and entitled “SMART ELEVATORSYSTEM AND METHOD”, now U.S. Pat. No. 6,615,175, each of the foregoingincorporated into the present application by reference in its entirety.

This application is also related to U.S. patent application Ser. No.12/703,666 filed Feb. 10, 2010 entitled “Adaptive Advertising Apparatusand Methods”, now U.S. Pat. No. 8,065,155; Ser. No. 12/704,431 filedFeb. 11, 2010 entitled “Adaptive Advertising Apparatus and Methods”, nowU.S. Pat. No. 8,078,473; Ser. No. 12/711,692 filed on Feb. 24, 2010entitled “ADAPTIVE INFORMATION PRESENTATION APPARATUS AND METHODS”, nowU.S. Pat. No. 8,065,156; Ser. No. 13/364,194 filed Feb. 1, 2012 andentitled “COMPUTERIZED INFORMATION PRESENTATION APPARATUS”, now U.S.Pat. No. 8,285,553; Ser. No. 13/362,902 filed Jan. 31, 2012 and entitled“ADAPTIVE INFORMATION PRESENTATION APPARATUS”, now U.S. Pat. No.8,370,158; Ser. No. 13/357,487 filed Jan. 24, 2012 and entitled“ELECTRONIC INFORMATION ACCESS SYSTEM AND METHODS”, now U.S. Pat. No.8,301,456; Ser. No. 13/404,606 entitled “COMPUTERIZED INFORMATIONPRESENTATION APPARATUS”, now U.S. Pat. No. 8,290,781; Ser. No.13/404,980 entitled “COMPUTERIZED INFORMATION PRESENTATION APPARATUS”,now U.S. Pat. No. 8,296,146; Ser. No. 13/404,853 entitled “COMPUTERIZEDINFORMATION PRESENTATION APPARATUS”, now U.S. Pat. No. 8,290,778; andSer. No. 13/405,046 entitled “COMPUTERIZED INFORMATION PRESENTATIONMETHODS” now U.S. Pat. No. 8,296,153, each filed on Feb. 24, 2012; Ser.No. 13/406,408 entitled “COMPUTERIZED INFORMATION SELECTION AND DOWNLOADAPPARATUS AND METHODS” filed on Feb. 27, 2012, now U.S. Pat. No.8,311,834; and Ser. No. 13/410,080 entitled “NETWORK APPARATUS ANDMETHODS FOR USER INFORMATION DELIVERY” filed Mar. 1, 2012, now U.S. Pat.No. 8,285,551, each of which is incorporated herein by reference in itsentirety.

This application is also related to co-owned and co-pending U.S. patentapplication Ser. No. 13/728,512 filed Dec. 27, 2012 and entitled “SMARTINFORMATION AND DISPLAY APPARATUS”; Ser. No. 13/728,715 filed Dec. 27,2012 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, nowU.S. Pat. No. 8,682,673; Ser. No. 13/737,833 filed Jan. 9, 2013 andentitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, now U.S. Pat.No. 8,706,504; Ser. No. 13/737,853 filed Jan. 9, 2013 and entitled“TRANSPORT APPARATUS WITH COMPUTERIZED INFORMATION AND DISPLAYAPPARATUS”, now U.S. Pat. No. 8,719,037; Ser. No. 13/746,266 filed Jan.21, 2013 and entitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”,now U.S. Pat. No. 8,781,839; Ser. No. 13/750,583 filed Jan. 25, 2013 andentitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, now U.S. Pat.No. 8,712,777; Ser. No. 13/752,222 filed Jan. 28, 2013 and entitled“COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”, now U.S. Pat. No.8,719,038; Ser. No. 13/753,407 filed Jan. 29, 2013 and entitled“COMPUTERIZED INFORMATION AND DISPLAY APPARATUS AND METHODS”, now U.S.Pat. No. 8,676,587; Ser. No. 13/755,682 filed Jan. 31, 2013 and entitled“INTELLIGENT ADVERTISING METHODS”; and Ser. No. 13/758,898 filed Feb. 4,2013 and entitled “INTELLIGENT ADVERTISING APPARATUS”, each incorporatedherein by reference in its entirety.

This application is also related to co-owned and co-pending U.S. patentapplication Ser. No. 14/488,239 filed on Sep. 16, 2014 and entitled“COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”; and U.S. patentapplication Ser. No. 14/488,235 also filed on Sep. 16, 2014 and entitled“TRANSPORT APPARATUS WITH COMPUTERIZED INFORMATION AND DISPLAYAPPARATUS”; U.S. patent application Ser. No. 14/491,880 filed on Sep.19, 2014 entitled “COMPUTERIZED INFORMATION PRESENTATION APPARATUS”;Ser. No. 14/493,198 filed on Sep. 22, 2014 entitled “COMPUTERIZEDINFORMATION APPARATUS”, Ser. No. 14/493,209 filed on Sep. 22, 2014entitled “PERSONNEL TRANSPORT DEVICE WITH COMPUTERIZED INFORMATION ANDDISPLAY APPARATUS”, Ser. No. 14/496,879 filed on Sep. 25, 2014 andentitled “COMPUTERIZED INFORMATION AND DISPLAY APPARATUS”; and Ser. No.14/500,837 filed on Sep. 29, 2014 and entitled “COMPUTERIZED INFORMATIONAND DISPLAY APPARATUS AND METHODS”, each also incorporated herein byreference in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to the field of personnel transportapparatus, and specifically to elevators and similar devices fortransporting people from one location to another which incorporatevarious information technologies.

2. Description of Related Technology

Elevators and similar personnel transport devices (such as movingwalkways or shuttles) are important aspects of modern urban life.Commonly used in office buildings, airports, shopping malls, and otherlarge structures, these devices transport large numbers of people andequipment between two locations on a routine basis. Elevators inparticular are widely used throughout the world.

Depending on loading, a person may spend up to several minutes on anelevator during travel between floors. Significant amounts of time mayalso be spent waiting for the elevator to arrive when called. This timeis usually “dead” from the standpoint that very little can beaccomplished or very few tasks undertaken during these few minutes.However, often times an individual may require information which will beof use after leaving the elevator. For example, the person may wish toobtain travel information such as directions to the nearest airport orpublic transportation node, or the location of a nearby restaurant.Weather-related information or traffic reports may also be useful. Aplethora of different types of information, including financial data,breaking news headlines, sports scores and the like may also be ofinterest to one waiting for or riding on an elevator or other transportdevice.

An associated problem relates to determining the location of a person,firm, or store within a building when unfamiliar. Building directoriesare often posted in the lobby of the building, yet these require theuser to manually or visually locate the name of the person, firm, orstore which they are looking for, and remember the location informationassociated therewith. Additionally, such directories often do notprovide precise location information, but rather merely a floor numberand/or suite number. The user often times does not have a graphicalrepresentation of the desired location in relation to the elevators,thereby resulting in additional wasted time in finding the location onceoff of the elevator. Even if a graphical display is provided, it oftenrequires the user to spatially orient themselves to determine relativelocation.

Security is also a concern when riding elevators late at night or toremote locations. Many elevator systems are used partly or entirelywithin parking garages, which often may be sparsely populated at offhours. People are all too frequently assaulted or robbed when departingfrom elevators under such conditions. Unfortunately, existing elevatorsystems do not have the facility to provide the occupant(s) with theability to selectively observe the area immediately surrounding theelevator doors on one or more destination floors, or otherwise takeprecautions to enhance their security.

Another problem associated with existing elevator systems relates totheir loading capacity. Often, especially at peak use hours such asduring the noon hour, the call buttons for several different floorswithin a building will be activated, and elevator cars which are at ornear their loading capacity will respond. With no additional roomavailable in the elevator, the person depressing the call button on agiven floor is left to wait for the elevator doors to close, depress thecall button again, and wait for another (hopefully partially vacant) carto arrive. This process not only delays the person waiting for the car,but also those on the elevator car(s), and those waiting on otherfloors.

In addition to the foregoing, many elevators must have a means ofrestricting access to certain floors during certain time periods whilenot interfering with other operations. These elevators generally alsoinclude means by which certain users may gain access to the restrictedfloors, such as a magnetic striped card which is inserted into a cardreader on the elevator. However, such card readers are prone to wear andhaving to re-swipe the card several times in order to obtain access.Furthermore, as the card wears due to repeated swiping or bending (suchas when left in the pocket of the individual carrying the card), thecard will be more prone to failure and will eventually requirereplacement. Also, such cards are prone to unauthorized use. Someonestealing or finding the lost card can simply insert it into the cardreader of the elevator and gain access to the restricted floor(s). It isalso noted that since access is restricted to certain floors typicallyduring late-night or weekend hours, HVAC and lighting systems aretypically turned off or dormant in order to conserve energy. Hence, whenthe user arrives at one of these restricted access floors, severalminutes are typically spent turning on the HVAC, lights, and any othernumber of electrical devices. Some systems require the user to inserttheir magnetic strip card in a separate reader, such as in the controlroom for the HVAC (which is typically located on a different floor), inorder to initiate equipment operation. This is obviously time consumingand cumbersome.

Lastly, there is often an element of discomfort associated with ridingan elevator car, especially when several individuals are present in thecar. Due in part to minimal space within the car and nothing to occupythe occupants attention visually, there is a natural tendency for one tostare up, down, or forward at the door of the elevator, or at the visualfloor indicators so as to avoid prolonged eye contact with the otheroccupants.

Heretofore, many of the technologies necessary to address theaforementioned issues have not been available or, alternatively, havebeen cost or space prohibitive to implement. However, recent advances indata networking, thin or flat panel display technology, personalelectronics, and speech recognition and compression algorithms andprocessing have enhanced the viability of such features from bothtechnological and commercial perspectives.

Based on the foregoing, there is a need for an improved elevator systemand method of operation which will reduce the time spent waiting for andtravelling on the elevator car, reduce the frustration associated withrepeated stops at different floors, and allow the occupants of theelevator (as well as those waiting for the car) to use their time moreefficiently and obtain needed information. Additionally, such anelevator system would enhance the security of the occupants upon egress,and allow for automatic recognition of an individual in order to provideaccess to certain restricted locations and initiation of certainfunctions such as lighting and HVAC.

SUMMARY OF THE INVENTION

In one aspect, computerized information and display apparatus isdisclosed. In one embodiment, the apparatus includes: a wireless networkinterface; processing apparatus in data communication with the networkinterface; speech processing apparatus in data communication with theprocessing apparatus; speech synthesis apparatus in data communicationwith the processing apparatus; an input device in communication with theprocessing apparatus and configured to, when actuated, cause thecomputerized information and display apparatus to enter a mode whereby auser can provide a speech input to the speech processing apparatus; adisplay device viewable by the user while providing the speech input;video data apparatus in data communication with the processing apparatusand the display device and configured to enable digital video data to bedisplayed on the display device; and a storage apparatus comprising atleast one computer program in data communication with at least theprocessing apparatus. In one variant, the computerized information anddisplay apparatus is configured to: after entry into the mode, obtaindigitized speech from the speech processing apparatus, the digitizedspeech generated based on the speech input received from the user, thereceived speech input comprising at least part of a name of a businessentity; cause, based at least in part on the digitized speech,identification of a match to the at least part of the name; causeretrieval of content associated with the match from a remote networkentity via the wireless network interface; and display the contentassociated with the match on the display device, the content aiding theuser in finding the business entity, the content comprising at least animage showing a location of the business entity and at least itsimmediate surroundings.

In another embodiment, the computerized information and displayapparatus includes a wireless network interface; processing apparatus indata communication with the network interface; speech processingapparatus in data communication with the processing apparatus; speechsynthesis apparatus in data communication with the processing apparatus;an input device in communication with the processing apparatus andconfigured to, when actuated, cause the computerized information anddisplay apparatus to enter a mode whereby a user can provide a speechinput to the speech processing apparatus; a display device viewable bythe user while providing the speech input; video data apparatus in datacommunication with the processing apparatus and the display device;sensor apparatus in data communication with the computerized informationand display apparatus; and a storage apparatus comprising at least onecomputer program in data communication with at least the processingapparatus.

In one variant, the computerized information and display apparatus isconfigured to provide information derived from multiple sources to theuser by at least: (1) receiving, upon actuation of the input device bythe user, a signal from the input device; based at least on the signal,entering the mode; obtaining digitized speech from the speech processingapparatus, the digitized speech generated based on the speech inputreceived from the user, the received speech input comprising at leastpart of a name of a business entity; causing, based at least in part onthe digitized speech, identification of a match to the at least part ofthe name; causing retrieval of content associated with the match from aremote network entity via the wireless network interface; and displayingthe content associated with the match on the display device, the contentaiding the user in finding the business entity, the content comprisingat least an image showing a location of the business entity and at leastits immediate surroundings; and (2) receiving data from the sensorapparatus; and generating, based at least on the received data, at leastone of an audible and/or visual alert, the at least one alert relatingto at least one of: motion sensed by the sensor apparatus; and/orinfrared radiation corresponding to a living being detected by thesensor apparatus.

In a further variant, the information and display apparatus is furtherconfigured to provide information derived from multiple sources to theuser by at least receiving digital video data from the video dataapparatus, the digital video data generated based on video signalsobtained from at least one camera apparatus; and displaying the receiveddigital video data on the display device.

In another embodiment, the computerized information and displayapparatus, includes: data processing apparatus comprising a centralprocessor and at least one digital signal processor; speech processingapparatus in data communication with at least a portion of the dataprocessing apparatus; speech synthesis apparatus in data communicationwith at least a portion of the data processing apparatus; an inputdevice in communication with at least a portion of the data processingapparatus and configured to, when actuated, cause the computerizedinformation and display apparatus to enter a mode whereby a user canprovide a speech input to the speech processing apparatus; a displaydevice viewable by the user while providing the speech input; video dataapparatus in data communication with at least a portion of the dataprocessing apparatus and the display device and configured to enabledigital video data to be displayed on the display device, the digitalvideo data generated based on video signals obtained from at least onecamera apparatus; sensor apparatus in data communication with thecomputerized information and display apparatus; data storage apparatusin data communication with at least a portion of the data processingapparatus; and a storage apparatus comprising at least one computerprogram and in data communication with at least a portion of the dataprocessing apparatus.

In one variant, the computerized information and display apparatus isconfigured to provide information to the user by at least: (1)receiving, upon actuation of the input device by the user, a signal fromthe input device; based at least on the signal from the input device,entering the mode; obtaining digitized speech from the speech processingapparatus, the digitized speech generated based on the speech inputreceived from the user, the received speech input comprising at leastpart of a name of a business entity; causing, based at least in part onthe digitized speech, identification of a match to the at least part ofthe name; causing retrieval of content associated with the match fromthe data storage apparatus; and displaying the content associated withthe match on the display device, the content aiding the user in findingthe business entity, the content comprising at least a graphicalrepresentation showing a rendering of a location of the business entityand at least its immediate surroundings; and (2) receiving data from thesensor apparatus; and generating, based at least on the received data,at least one of an audible and/or visual alert, the at least one alertrelating to at least one of: motion sensed by the sensor apparatus;and/or infrared radiation corresponding to a living being detected bythe sensor apparatus.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of one embodiment of the information andcontrol system of the invention, showing those components local to eachelevator car.

FIG. 2 is a plan view of a first embodiment of the interface panel ofthe information and control system of FIG. 1, including the touch keypadand the display device.

FIG. 3 is a block diagram of one embodiment of the information andcontrol system network architecture.

FIG. 4 is a logic diagram illustrating the operation of one embodimentof the building directory sub-system of the invention.

FIG. 5 is a plan view of one embodiment of a building directorysub-system graphic location file, as shown on the display device of theinformation and control system.

FIG. 6 a is a plan view of one embodiment of a network input devicehaving dedicated function keys thereon.

FIGS. 6 b and 6 c illustrate one embodiment of an exemplary coordinatedgraphic weather display according to the present invention.

FIG. 7 is a plan view of one embodiment of the PED data downloadterminal of the invention.

FIG. 8 is a block diagram of one embodiment of the capacity sensingsub-system according to the present invention.

FIG. 9 is a plan view of one embodiment of the elevator floor sensorarray used in conjunction with the capacity sensing sub-system of FIG.8.

FIG. 10 is a logic diagram illustrating the method of operation of thecapacity sensing sub-system of FIG. 8.

FIG. 11 is a block diagram illustrating one embodiment of the monitoringand security sub-system of the present invention.

FIG. 12 illustrates one embodiment of the elevator car touch panel usedin conjunction with the monitoring and security sub-system of FIG. 11.

FIG. 13 is a block diagram of a second embodiment of the monitoring andsecurity sub-system of the present invention.

FIGS. 14 a and 14 b are plan views of one embodiment of the parking andvideo monitoring displays, respectively, of the monitoring and securitysub-system of FIG. 11.

FIG. 15 is a block diagram illustrating one embodiment of theidentification and access sub-system of the present invention.

FIG. 16 is a logic diagram illustrating the operation of theidentification and access sub-system of FIG. 15.

FIG. 17 is a plan view of one embodiment of a utility services selectiondisplay associated with the identification and access sub-system of FIG.15.

FIG. 18 a is a logic diagram illustrating the operation of a firstembodiment of the prompt mode of the adaptive advertising sub-system ofthe invention.

FIG. 18 b illustrates the library data file structure used inconjunction with the advertising sub-system of the invention.

FIG. 18 c is a logic diagram illustrating the operation of a secondembodiment of the advertising sub-system of the invention.

FIG. 18 d is a logic diagram illustrating the operation of a thirdembodiment of the adaptive advertising sub-system of the invention.

FIG. 19 is a logic diagram illustrating the operation of a fourthembodiment of the adaptive advertising sub-system of the invention.

DESCRIPTION OF THE INVENTION

Reference is now made to the drawings listed above, wherein likenumerals refer to like parts throughout.

It is noted that while the system and methods of the invention disclosedherein are described primarily with respect to an elevator car, certainaspects of the invention may be useful in other applications, including,without limitation, other types of personnel transport devices such astrams or shuttles or moving walkways, or stationary devices such askiosks within the lobby or elevator waiting areas of a building. As usedherein, the term “building” is meant to encompass any structure, whetherabove ground or underground, permanent or temporary, used for anyfunction.

GENERAL DESCRIPTION

Referring now to FIGS. 1 and 2, one embodiment of an improved elevatorinformation system is generally described. As shown in FIG. 1, thesystem 100 includes an input device 102, speech recognition (SR) module104, central processor 106 with associated motherboard 121, video RAM107, non-volatile storage device 108 containing a database (not shown),graphics co-processor 109, volatile or dynamic storage device 110 withassociated DMA module 139, audio amplifier and speaker module 111,speech synthesis module 112, micro-controller 123, PCI slots 147, anddisplay device 113. The system also includes a serial bus with universalasynchronous receiver transmitter (UART) 117 or alternatively universalserial bus (USB), as described in greater detail below with respect toFIG. 7. As shown in FIG. 2, the input device 102 of the presentembodiment is a touch-sensitive keypad and/or display screen of the typewell known in the electrical arts. The input device 102 includes avariety of different functional keys 114 on a keypad 116 (and/or on atouch-sensitive display screen 113, as described below) which allow theuser to initiate a query of the database either manually via the keypad116, display device 113, or audibly through the speech recognitionmodule 104.

As shown in FIG. 1, the speech recognition module 104 of the presentinvention includes a high quality, high SNR audio microphone 118,analog-to-digital converter (ADC) 141, and linear predictive coding(LPC)-based spectral analysis algorithm run on a digital signalprocessor 125 having associated SR module RAM 127. It will be recognizedthat other forms of spectral analysis, such as MFCC (Mel FrequencyCepstral Coefficients) or cochlea modeling, may be used. Phoneme/wordrecognition in the present embodiment is based on HMM (hidden Markovmodeling), although other processes such as, without limitation, DTW(Dynamic Time Warping) or NNs (Neural Networks) may be used. Myriadspeech recognition systems and algorithms are available, all consideredwithin the scope of the invention disclosed herein.

In the present embodiment, CELP-based voice data compression is alsoutilized for transmission and storage of voice data. CELP algorithms ingeneral are useful for converting analog speech to a compressed digitalformat which is more rapidly and easily manipulated and stored within adigital system using less bandwidth and memory. CELP algorithms and lowbit rate vocoder technology are well known in the signal processing art,and accordingly will not be described further herein. Note that as usedherein, the term CELP is meant to include any and all variants of theCELP family such as, but not limited to, ACELP, VCELP, and QCELP. It isalso noted that while CELP is used as the basis of compression withinthe system 100, other types of compression algorithms and techniques,whether based on companding or otherwise, may be used. For example, PCM(pulse code modulation) or ADPCM (adaptive delta PCM) may be employed,as may other forms of linear predictive coding (LPC).

As illustrated in FIG. 1, signals generated by the microphone 118 aredigitized by the ADC 141 and processed using the aforementioned speechrecognition algorithm and the DSP 125 to produce digital representationsof the user's speech. The speech library or dictionary stored within theSR module memory 127 is used by the DSP 125 to match phenome stringsresulting from the LPC analysis with known words. Once a “match” isidentified, the central processor 106 and/or micro-controller 123implement the desired functionality, such as retrieving one or more datafiles from the storage device 108 for display on the display device 113.

The DSP 125 of the present embodiment is a Texas Instruments TMS320C6xVLIW digital signal processor or equivalent, although it will berecognized that other types of processors may be used. The ‘C6x DSP ischosen for its speed and capability, thereby allowing for real-timespeech recognition. The central processor 106 and associated motherboardarchitecture (e.g., northbridge, southbridge, etc.) is optimally anIntel Pentium II®-based design, although others, such as the AMDK600-series processors, may be used in place of the Pentium II®. Theaforementioned USB is also advantageously used with the Pentiumarchitecture.

The information and control system keypads 116 and displays 113 (FIG. 2)are placed at waist and eye level, respectively, within the elevator car180 to facilitate easy access and viewing by the user, and limit theamount of incidental contact by passengers in the elevator. A pluralityof different input/display devices are optimally disposed within thesmart elevator to allow multiple occupants to obtain informationsimultaneously. A capacitive “touch keypad” is used as the input device102 in the present embodiment to increase input device longevity andthwart vandalism. Specifically, since the function keys 114 on thekeypad 116 do not have a mechanical actuating device (such as a springand set of electrical contacts) which will wear with time, they will asa general rule last longer. Additionally, since the keypad 116 has noopenings in the vicinity of the individual keys, any incidental contactwith deleterious substances such as cleaning fluids will not affect theoperation of the system or degrade its longevity. Similarly, vandalismis discouraged, since there are no openings or other access pointspresent within the interior of the elevator car. The keypad 116 may alsobe covered with a protective coating of the type well known in the artwithout affecting the operation of the panel, since, if properly chosen,such a coating merely acts as a dielectric for the capacitor formedbetween the underlying contacts and the user. It will be recognized,however, that any number of input devices, including “mechanical”keypads, trackballs, light pens, pressure sensitive “touch” keypads, orthe like may be used in conjunction with the present invention if sodesired. The touch keypads 116 are, in the present embodiment, mountedflush with the vertical wall surfaces 177 of the elevator car so as tomake them as physically unobtrusive as possible.

The touch-screen display 113 generates a variety of different messagesor display formats based on the user's input and query. These messagesand formats are stored as digital data on the storage device 108 (andtemporarily in video RAM 107) which is accessed by the processor 106.The display devices 113 of the present embodiment are low profilecapacitive LCD touch screen devices of the type well known in the art,although other types of displays, including “flat” cathode ray tubes,plasma, or TFT displays may be used. Such displays optimally limit theamount of space required external to the interior volume of the elevatorcar to accommodate the system 100 of the present invention. Furthermore,it is noted that a non-touch sensitive display (not shown) may be usedwith the aforementioned input device 102 if desired, the latter actingas the sole input device (other than the speech recognition module 104and associated microphone 118).

In the embodiment of FIGS. 1-2, the processor 106, video RAM 107,storage devices 108, 110, and other components (including necessarypower supplies, not shown) are disposed within equipment storagehousings (not shown) located on the exterior of the elevator car 180 soas to be invisible to the occupants thereof. This arrangement is usedprimarily to allow rapid access to and processing of data by the system100, thereby facilitating the rapid delivery of information to thesystem user. Hence, the information and control system 100 of eachelevator car is to a degree “self contained”, with the exception ofseveral common functions performed by a central server 170.

As shown in FIG. 3, the central server 170 is located remotely from theelevator cars and connected to the elevator car “clients” 180 via alocal area network architecture such as a bus, star, ring, star/bus, orother similar topology. A bus topology is shown in FIG. 3. The networkmay operate according to any number of networking protocols including,for example, ATM, Ethernet, Gigabit Ethernet, IP, IP over ATM, or X.25.Connection cabling from the peripheral component interconnect (PCI)slots 147 on each motherboard 121 carrying the network interface devices(such as a LAN card) is run alongside the existing elevator power andcontrol cables within the cable bundle servicing each car.

In an alternative embodiment, data may be transferred between theelevator cars 180 and the to remote server 170 via a wireless interface310 (FIG. 3) such as a direct sequence spread spectrum (DSSS) orfrequency hopping spread spectrum (FHSS) system as specified by IEEEStandard 802.11. It will be recognized, however, that any wirelessinterface capable of accommodating the bandwidth requirements of thesystem 100 may be used. Optical networking architectures and protocols(such as SONET) may also be used if desired; optical modulators anddemodulators 320, 322 of the type well known in the data networking artsare employed for transferring data between the server 170 and theclient(s) 180 in such architectures.

It will be appreciated that many different arrangements for thedisposition of various components within the system, including, interalia, the processor/motherboard, storage devices, server, and memory(and the transfer of data and signals there between) are possible, allof which are encompassed within the scope of the present invention.

Building Directory Sub-System

The operation of the building directory sub-system is now described ingreater detail with reference to the logic diagram of FIG. 4, and thecomponents of FIGS. 1-3. As used herein, the term “building directorysub-system” refers to that collection of components, firmware, andsoftware within the information and control system 100 of FIG. 1 whichperform the building directory functions as described in the followingparagraphs.

Upon entering the elevator, the user initiates the “Building Directory”function of the system by pressing a function key 122 on the keypad 116or touch display 113. The keypad 116 and/or key 122 may be labeled withan appropriate label such as “Building Directory” or the like. Upondepressing the function key 122, a signal is generated which prompts thesystem to respond with an audible and/or visual query to the user,depending on how the system is pre-configured. For an audible query, thesub-system of the present embodiment retrieves a pre-stored CELP (orother compressed format) data file from one of the storage devices 108,110 and converts that file to an analog audio representation of voicevia the speech synthesis module 112 and processor 106. Speech synthesistechnology is well known in the signal processing arts, and accordinglywill not be discussed further herein. The audio signal from thesynthesis module 112 is applied to the amplifier and audio speaker 111to generate a voice prompt, such as “Name?”. Alternatively, orsimultaneously if desired, the system 100 retrieves a separate data filefrom the storage device 108, 110 which represents the current buildingdirectory. The building directory data file contains a plurality ofentries relating to tenants in the building where the system 100 islocated. Each entry is parsed into data fields which contain, interalia, the firm or entity name, its location (such as floor and suitenumber), and a list of the first and last names of all persons employedthere. The processor 106 (and associated graphics co-processor 109 withvideo RAM 107) initiate the display of all retrieved data entries in thedirectory file on the display device 113 in a convenient format, such asan alphabetical list from which the user can select their desiredoption. The user may then speak the specific name of the party they wishto find, or select the name using the touch display 113 or other inputdevice (such as a track ball; not shown). When the user speaks the nameof the party desired, the speech recognition module 104 takes the analogsignal from the microphone 118 and converts it to a digital format byway of the DSP 125 and compression algorithm, as previously described.The directory file is retrieved (if not already done), and the digitizedand coded speech compared to the contents of the directory file to findany matches. Any matching fields within the entries of the data file areprovided to the user, either audibly via the speech synthesis module 112and speaker 111 using prompts, or visually via the display 113. In thepresent embodiment, audible prompts for a single matching entry are ofthe form: “[Name], [Company], located at Suite X on Floor Y”. Formultiple matching entries, the audible prompts are produced in asequential, predetermined order (such as the numerical sequence numberof the entries within the directory file). For example, the firstmatching entry (alphabetically) would be synthesized in the foregoingform, followed by the second entry, etc. Upon hearing the desired matchin this voice activated embodiment, the user simply states “Stop”, tochoose the entry desired. At this point, a separate audio prompt isgenerated (such as “Select (floor number) Floor?”) which prompts theuser to either select the floor number associated with the matcheddirectory item and terminate their session (such as by stating “yes”),or continue on with the next entry (such as by stating “no”) until allentries are exhausted. The directory sub-system is programmed to storein memory 110 and “remember” previous files retrieved within a givenuser's session so as to not repeat the same selections during that samesession. For example, if there are five “Smith” entries in the directoryfile, and the user enters the query “Smith”, the sub-system will selecta different “Smith” entry on each subsequent user query during the samesession until the correct Smith is located or all matching entries havebeen exhausted. In the present embodiment, a session is defined as thetime period between two successive selections of the “BuildingDirectory” function key 122, or the expiration of a predetermined periodof time without a user input after selection of that function. Thesub-system is also optionally programmed to allow the user to appenddefining information to the initial query statement to form a Booleansearch statement. For example, if the first “Smith” selected by thesub-system is not the desired one, the user may then append the query bysaying “ABC Corporation” or “John” in response to the next “Select(floor number) Floor?” query by the sub-system. The sub-system will thenrecognize the new entry, and search all fields in all “Smith” entries tolocate those listings having both the name “Smith” and “ABC Corporation”(or “John”), using Boolean “AND” logic. The user will then be promptedagain to “Select (floor number) Floor?”. If no matching entries arefound, the sub-system will either notify the user to this effect, suchas using an audio message such as “No matches found”, or will display orannounce the nearest approximation of the query based on a confidencerating. The confidence rating is calculated, for example, by theprocessor 106 running an algorithm; such confidence rating calculationalgorithms are well understood, and indicate the quality of the matchusing a numeric value or index.

As used herein, the term “match” includes any predetermined criteria forcorrelating one piece of data to another. For example, the buildingdirectory sub-system may be programmed to consider two pieces of data a“match” when all bits with the exception of the least significant bit(LSB) are identical. Many such criteria are possible, and all areconsidered to be within the scope of the invention disclosed herein.Furthermore, partial matches, such as when the user enters one wordwhich is matched within several different entries of the directory file,may be used as the basis for an appended search, as described below.

The directory file described above also optionally has a locationgraphic data file appended or linked thereto, which is retrieved fromthe storage device 108, 110 or the server 170. The location graphic fileis displayed on the display device 113 as a floor map graphic 502illustrating the location of the selected person or firm 504 on thatfloor in relation to the elevator cars 180, as illustrated in FIG. 5.For example, the location of the individual or firm being sought isilluminated or colored, made to flash, and/or an illuminated arrow 506is made to point to the desired location from the elevator. Numerousdifferent and well understood visual and audible formats for providingthe user with the desired information may be used with equal success,all of which are considered within the scope of the present invention.

The directory system 200 of the present embodiment also optionallyincludes directory files for nearby office buildings or establishments,thereby alerting the user through visual or audible prompt that they arein the wrong location once a match is confirmed by the user.

The user's session is terminated, or a new query initiated, when the“Building Directory” function key 122 is again depressed, after apredetermined time period without a user input, or upon the occurrenceof some other event as desired.

Network Interface

The information system 100 described above may also include otherfunctional aspects. As illustrated in FIG. 3, one embodiment of thesystem includes a network interface 300 (such an internet or intranetdata link) which permits the user to rapidly access updated informationon a variety of predetermined topics of interest. For example, the inputdevice 102 and/or display 113 of FIG. 2 is configured to includededicated function keys 602 correlating to Internet hypertext markuplanguage (HTML)-based hyperlinks, the hyperlinks corresponding to URLs(universal resource locators) for news headlines, weather, sportsscores, financial data, directions to local airports or publictransportation, etc as shown in FIG. 6 a. Alternatively, the functionkeys 602 provide the user access to addresses within a local or remoteserver 170 via a LAN or intranet, which has the desired informationstored thereon. The function keys may also be integrated with the touchdisplay 113 (and the components previously described with reference toFIGS. 1 and 2 above) to allow the user to interact with the system 100via both the input device 102 and “soft” function keys on the touchdisplay 113. For example, if the “Weather” function key 604 is selected,the display would retrieve and generate an HTML page with representationof a map of the United States with hyperlinks for each state (FIG. 6 b).Once a state or geographical area was selected by the user via thehyperlinked “soft” keys 620 on the touch display 113, the user would bepresented with the desired weather information on the display, such asthe current weather conditions and five-day forecast in a mixedtextual/graphic format such as that of FIG. 6 c. Preset function keysand graphic representations with icons are used in the presentembodiment to facilitate rapid access and display to a more narrowlytailored collection of data, since most users will have only seconds tolocate, interpret, and remember the desired information. The generationof textual, graphic or mixed media displays based on HTML or otherlanguages or formats is well known in the computer arts, and accordinglywill not be described further herein.

The information and control system 100 may also be programmed to provideinformation via the display unit(s) 113 on a rotating basis without theneed for user intervention. For example, a given display unit 113 may beprogrammed to display a summary of local weather for the next five days(such as that shown in FIG. 6 c) for a first period of time, followed bya brief summary of breaking headlines for a second period, followed byfinancial highlights for a third period, and so forth. The update rate(i.e., the time between changing of the displays) should be adjusted soas to permit for adequate recognition and use by the occupants. Anupdate rate of approximately 10-15 sec. should be sufficient for mosttopics and applications, although this period may be varied as needed.

Referring again to FIG. 3, connection of the information and controlsystem 100 to external LANs, WANs, intranets, or internets (e.g., theInternet) is accomplished via the network interface 300. In oneembodiment, this interface 300 comprises a so-called “cable modem” ofthe type well known in the networking arts. Such cable modemseffectively overlay IP data on a coaxial cable which is also used tosupply analog video data to the end user. In the case of an elevatorsystem, cabling between the system server 170 and each car 180 may berun in parallel with the existing electrical services cable bundle, oralternatively a wireless interface (such as the aforementioned DSSS orFHSS transceiver 310) employed to transmit data between the cars and theserver 170. Many configurations for transmitting data between the carsand the system server 170 may be used. Alternatively, a dedicatedintegrated services data network (ISDN) line may be used to by theserver 170 to access external networks such as the Internet.Furthermore, it is feasible to utilize a wireless link as the networkinterface 300 between the server 170 and the LAN, intranet, or internet307.

Information Download to PED

Referring now to FIG. 7, another embodiment of the information andcontrol system 100 of the present invention is described. In thisembodiment, the system 100 is additionally provided with one or moredata terminals 702 which allow the user to plug a personal electronicdevice (PED) 704 having a standardized interface into the system toobtain a “download” of information. As used herein, the term “PED”includes, but is not limited to, personal digital assistants (PDAs) suchas the Apple Newton®, US Robotics/3COM PalmPilot®, or Palm III®, laptopcomputer, notebook computer, or the like. The data terminal includes aconnector 712 which is a 9-pin RS-232 serial connection of the type wellknown in the electronic arts, although other types of connectors andprotocols may be used. The download between the system 100 and the PED704 may be automatically initiated by plugging the PED 704 into the dataterminal 702 and thereby mating the connector 720 of the PED 704 withthe connector 712 of the data terminal 702, or manually initiated by theuser via the input device 102, touch display 113, or the PED 704software. The data terminal 702 is connected to the serial bus andprocessor 106 of the system 100 as shown in FIG. 1, whereby theprocessor 106 retrieves data stored on the storage device 108, 110, oralternatively downloads data from an external source via the networkinterface 300. A universal asynchronous receiver/transmitter (UART) 117or universal serial bus (USB; not shown) of the type well known in thecomputer arts is used to electrically interface the processor 106 of thesystem 100 and the PED 704.

As shown in FIG. 7, the PED 704 is received within a conformal slot 706formed in the display panel 708, thereby automatically aligning the dataconnector 720 of the PED 704 to that of the system 100. The slot 706includes a spring-loaded cover 713, and is sealed against anyintroduction of deleterious fluids or other material, and the terminalpins 710 of the connector 712 are recessed so as to avoid incidentaldamage. Once the download is complete, the user simply removes the PEDfrom the slot. Based on the volume of data downloaded, the entiretransaction takes only a few seconds. Application software resident onthe PED 704 is adapted to receive the downloaded data, store it withinthe storage device of the PED (not shown), and display it at a latertime. In one embodiment, the downloaded information comprises anelectronic “newspaper” having information relevant and useful to theuser, such as national/local news, weather, sports, and the like. Othertypes of information, such as the building directory, firm resumes,local telephone directory, maps of the local area, and such may bedownloaded as well. In another embodiment, the user may select the typeof information downloaded using a menu of function keys 114 on the panelkeypad 116 or touch screen display 113. For example, the user firstselects the “Download” function key, which then activates a menu on thetouch display 113 which allows him/her to select from a number ofpre-determined types of information using either dedicated function keysor alternatively functions shown on the touch screen display 113. In yetanother embodiment, the configuration of the data downloaded via theterminal 702 is determined based on data received from the RFID tag ofthe user, as described in greater detail below with respect to FIG. 15.In this fashion, the user may automatically receive information“tailored” to his/her needs.

Capacity Sensing Sub-System

Referring now to FIG. 8, the elevator system of the present inventionfurther optionally includes a capacity sensing sub-system 800 whichdetects the loading of the elevator car and selectively bypasses floorswhen the capacity is met, unless the floor is selected by one of theoccupants of the car. In the embodiment of FIG. 8, the flooring 804 ofthe elevator car 180 is equipped with a plurality of piezoelectricsensors 806 which generate electrical signals based on the pressure (andforce) applied to them. Such sensors are well known in the electricalarts, and it will be recognized that other types of sensors and sensingarrangements may be used. The sensors 806 are calibrated or nulled forthe weight of the elevator flooring 804 and any pre-load resultingtherefrom. The electrical signal produced by each of the sensors 806 isamplified and made linear by a first stage amplifier 808 and fed to asumming amplifier 810 which sums the values for all of the sensors 806to produce a composite signal 812 proportional to the summed signals ofall the sensors. The composite signal 812 is integrated or averaged overthe entire time travelling between floors by an integrator circuit 813(or alternatively, an algorithm running on the processor 814), therebyaccounting for any apparent increase in weight due to acceleration inthe upward direction or deceleration in the downward direction, orapparent decrease in weight due to deceleration in the upward directionor acceleration in the downward direction. Linearization of the outputof each sensor 806 is required when the voltage output of the sensor isnot linear with respect to pressure; this allows the linear signals tobe summed directly within the summing amplifier 810, the output of which812 is linear in voltage with respect to pressure.

The composite signal 812 from the integrator 813 is correlated using theprocessor 814 to a known weight using a proportionality or scalingconstant stored in memory 815, and ultimately to a first estimate of thenumber of occupants within the car_by way of another scaling constantalso stored in memory 815. For example, if a total pressure readingequating to 1500 lbs. (after null calibration) was obtained from thesumming amplifier 810, it could be correlated to an occupancy of tenpersons, assuming that the average person weighs 150 lbs. and that theirdistribution within the car was uniform.

However, such “average” cases of weight and distribution thereof withinthe car 180 do not always occur, since often times people riding in thecar may have significant disparities in size and weight, or may betransporting heavy objects. Furthermore, weights which are not aninteger multiple of the scaling constant present the system with anambiguity that must be resolved; i.e., how to round fractional amountsof a person. Accordingly, to address these situations, the firstembodiment of the sub-system 800 of the present invention compares theforegoing first occupancy estimate to the number of different sensors806 supplying a non-zero signal to the summing amplifier 810 as measuredby a counter circuit 811. The number of sensors 806 supplying a non-zerosignal is used as a lower limit on the occupancy estimate. Additionally,the number and disposition of sensors 806 within the car 180 are chosento provide the sub-system 800 with information regarding thedistribution of weight therein. For example, the elevator car 180 of thepresent embodiment is equipped with sixteen sensors positioned in a 4×4array of four rows and four columns, each sensor 806 being centeredwithin its fractional ( 1/16^(th)) area of the flooring, as shown inFIG. 9. Assume that the weight of 1500 lbs. is distributed within thiscar of FIG. 9 such that sensors “1” and “2” produce signals proportionalto 100 lbs. each, sensors “10” and “11” produce signals proportional to110 and 40 lbs. respectively, and sensors “13” and “14” produce signalsproportional to 150 lbs. each. Hence, the total weight present in thecar is 650 lbs. Assuming a scaling constant of 150 lbs. per person, afirst occupancy estimate (O_(E)) of 4.33 persons is produced. Since sixdifferent sensors 806 are producing non-zero signals, with four of thesix (i.e., “1”, “2”, “13”, and “14”) producing signals equal to those ofat least one adjacent sensor. As used herein, two sensors are adjacentwhen they are within one row and one column of each other. The remainingtwo of the six sensors in this example (i.e., “10” and “11”) areproducing signals different from those of adjacent sensors. Lookingpurely at the number of sensors producing non-zero signals (six), therecould theoretically be as many as six different entities within the car,assuming that no entity can take up less than 1/16^(th) of the availablefloor space within the car. Specifically, two 100 lb. people could bestanding next to one another atop sensors “1” and “2”, a 110 lb. and 40lb. person atop sensors “10” and “11”, respectively, and two 150 lb.people atop sensors “13” and “14”. This number is the uncorrectedoccupancy maximum value, O_(maxu). Alternatively, however, it may beconcluded that as few as three people could be in the car, based on theassumption that a person may occupy up to and including two adjacentsensors (i.e., no more than 2/16ths or ⅛th of the floor space in thecar). For example, a 200 lb. person could be standing atop sensors “1”and “2”, with their weight equally distributed. Similarly, a 150 lb.person could be standing atop sensors “10” and “11”, with weight shiftedmostly onto sensor “10”. The third (300 lb.) person could be atopsensors “13” and “14”, with weight equally distributed. This lattervalue is the occupancy minimum based sensor data, O_(mins). Note thatfor purposes of calculating O_(mins), each sensor is only counted once.

Hence based on the foregoing, the sub-system 800 would need to resolvethe ambiguity between (i) the first estimate calculated based purely onweight and a predetermined scalar quantity; (ii) the maximum theoreticalnumber of occupants based on weight sensor data; and (iii) the minimumtheoretical number of occupants based on weight sensor data. To resolvethis ambiguity, the sub-system 800 of the present embodiment imposes therestriction that any entity atop a sensor producing a signalproportional to less than an arbitrary lower threshold (say, 50 lbs. inthe present example) which is adjacent to another sensor producing anon-zero signal is part of the same entity atop that adjacent sensor. Inthe foregoing example, sensor “11” registers only 40 lbs. of weight, andis adjacent to both sensors “10” and “14”, which have non-zero output.Hence, the signal output from sensor “11” is assumed to be part of thesame entity which is atop sensors “10” or “14”. Since no other sensorsin the foregoing example registered less than the assumed threshold of50 lbs., all other sensors are presumed to have a distinct entity atopthem. Hence, the corrected maximum number of entities calculated by thesystem (O_(maxc)) is reduced from 6 to 5. Note that once a sensor havinga weight value less than the threshold is “paired” with another adjacentsensor, that adjacent sensor can not be paired with any others, therebypreventing double-counting. This restriction also addresses the instancewhere the measured weight on a given sensor of interest is above thelower threshold value, yet is due to two entities each located onadjacent sensors as well as the sensor of interest.

To further assist in resolving occupancy estimate ambiguity, theforegoing information is also correlated with the number of differentfloors selected within the elevator on the selection panel 820.Specifically, the number of different floors selected on the elevatorcar selection panel are used as a second lower limit or occupancyminimum, O_(minp). Using the preceding example, if the sub-system 800detects that five different floors were selected, the system wouldrecognize the presence of five persons, one corresponding to eachdifferent floor selected. It is assumed that the instance wherein oneperson selects multiple floors (such as through inadvertent or mistakenfloor selection) would occur infrequently, and would also not be of anysignificance since the number of people actually on the elevator in suchinstances would always be less than the estimate derived by the system,thereby affording more space within the car than estimated. In theconverse situation, for example when the first occupancy estimate ormaximum estimate indicate the presence of several different persons, yetthe number of different floors selected is fewer, the system does notset the fewer number of floors equal to the number of occupants, sincethe additional weight is likely represented by additional passengersgetting off at the same floor(s), or few passengers having cargo orother weighty objects with them in the elevator.

Lastly, the sub-system 800 utilizes (i) the first occupancy estimateO_(E), (ii) the corrected occupancy upper limit O_(maxc) determined bythe number of sensors 806 with non-zero output that exceed thepredetermined threshold value, (iii) first occupancy minimum O_(mins) asdetermined by the number of adjacent sensor pairs, and (iv) secondoccupancy minimum O_(minp) as determined by the number of floorsselected within the car 180, to produce a final occupancy estimate.Specifically, this final occupancy estimate O_(f) is the greater of thefirst occupancy estimate, corrected occupancy upper limit, the firstoccupancy minimum, and the second occupancy minimum. In the foregoingexample, these quantities are 4.33 persons, 5 persons, 3 persons, and 5persons; hence, O_(f) equals 5 persons. Note that the highest value ischosen for conservatism; this all but eliminates instances of theelevator car stopping at a floor with an active call signal when noadditional room exists, yet does not so under-utilize the car's capacityso as to be grossly inefficient. FIG. 10 illustrates the logical flow ofthe foregoing embodiment of the method.

As a second example of the operation of the capacity sensing sub-system800, consider if 16 children each having a weight of 75±20 lbs. (and anaverage weight of 75 lbs.) were present in the previously describedelevator car. The total combined weight would equal 1200 lbs., andtherefore O_(E) would equal 1200/150 or 8. If O_(E) alone were used inthis instance, it would severely overestimate the remaining capacity ofthe elevator car. Next, assume each child to take up the spaceassociated with one sensor, whether individually or in combination;hence, O_(maxu) would equal 16, and O_(mins) would equal 8. Since nosensors 806 would register less than the assumed threshold value of 50lbs. (i.e., each sensor would be associated with one whole child orone-half of two children), O_(maxc) would equal O_(maxu). If 2 differentfloors were selected by the 16 children, then O_(minp) would equal 2.Hence, in this example, O_(f) would equal O_(maxu) or 16 persons, whichmatches the actual occupancy exactly.

Note that due to the reduced size of children as compared to the averageadult, it may be possible to have somewhat more children than adultswithin a given floor space of the elevator car; however, this effect isconsidered minimal since a child is generally much shorter than theaverage adult, and hence grows disproportionately in height as opposedto width (the latter relating to floor space required to accommodatethem). Stated differently, there is a minimum of floor space that anyfree-standing human requires; this value can be estimated and built intothe sensor array design of the present invention.

When the capacity of the elevator car 180 is reached, either by totalsensed weight or by the maximum number of occupants allowed (apredetermined value) as estimated by the sub-system 800, any subsequentcall signals received by the elevator control circuit 830 are routed toanother available car based on inputs received from a micro-controller817. In this fashion, the fully loaded car bypasses those floors withpeople desiring to get on the elevator, unless those floors are selectedby one or more of the occupants of the car 180.

Similarly, as each successive floor selected by occupants of theelevator car 180 is reached (as based on an door open sensor 850 withinthe elevator control logic, or other indicia), the sub-system 800recalculates the first occupancy estimate O_(E), the corrected occupancyupper limit O_(maxc), the first occupancy minimum O_(mins), and thesecond occupancy minimum O_(minp) and produces a new final occupancyestimate O_(f) based thereon. Hence, occupancy estimation according tothis embodiment is an ongoing and dynamic process.

Monitoring and Security Sub-System

Referring now to FIGS. 11 and 12, the information system 100 of thepresent invention optionally also includes an external monitoring andsecurity sub-system 1100 to enhance the safety of the occupants andprovide “early warning” of possible threats. Specifically, theaforementioned display device(s) 113 within the car 180 may beconfigured using one or more preset function keys to provide a displayof the area immediately surrounding access to the elevator on certainselected floors, such as parking garages. Video cameras 1102 of the typewell known in the electronic arts are positioned at certain advantageouslocations 1104 surrounding the elevator car doors on certain floors ofinterest generate a video signal which is passed to the informationsystem displays 113 through the aforementioned coaxial cable in theelevator wiring harness 1108. These video signals are selectively inputto the display unit 113 for viewing by the car occupants. As shown inFIG. 12. the display unit is controlled using “Video” function keys 1110on the keypad 116 or touch screen 113 to permit the user to select oneor more floors to view. “PIP”, or “picture-in-picture” technology of thetype well known in the electronic arts, along with a video multiplexer1112 allows users to cascade two or more images on the display 113 ifrequired. The user can over-ride the car stopping at any selected floorif desired, simply by depressing the “Override” function key 1114followed by the numeric key corresponding to the floor number. Thisoverride function can be instituted any time up until the signal isgenerated by the elevator control circuit 830 and associated logic toopen the elevator car doors 1106 at that floor. The user can alsocontact a remote security station 1125 if desired using a “SecurityCall” function key 1120 present on the keypad 116 or the touch screen113, and/or initiate temporary additional lighting 1122 in the area bydepressing a “Lights” function key 1124.

The features described above can also be “locked out” during certainperiods of the day (such as during busy morning or afternoon hours) whenmany people ride the elevators and the viewing, override, security, andlighting functions are generally not needed. For example, programming ofthe processors 106 within each elevator car in an office building couldinstitute the monitoring/override function from the hours of 6 pm until8 am and during weekends. Such programming can be reconfigured using theremote system server 170 and associated input device 171, as shown inFIG. 11.

In an alternate embodiment (FIG. 13), one or more miniature CCD cameras1310 are positioned at various locations 1104 around the elevator doors1106, so as to be effectively invisible to any person standing in thoselocations. In this fashion, criminals waiting to assault the occupantsof the elevator car upon their egress would likely not be alerted to thepresence of the monitoring system or cameras, thereby removing incentivefor them to wait in unmonitored areas so as to avoid being seen by thecameras. The CCD cameras 1310 of the embodiment of FIG. 13 output analogsignals to amplifiers 1312, a sample and hold circuit 1314, and A/Dconverters 1316, and then to a digital signal processor 1318 running avideo compression algorithm via a multiplexer 1319. Serial and paralleldrivers 1320, 1322 and a clock driver 1324 are also used to supportoperation of the CCD 1310, as is well understood in the electronic arts.The compressed data is then modulated onto an RF carrier by themodulator 1330, or alternatively a direct sequence or frequency hoppingspread spectrum waveform for transmission to the display unit 113, whichincorporates a spread spectrum receiver 1331 and video driver circuit1333. Using the foregoing architecture, video images generated by theCCD cameras 1310 are digitized and compressed so as to reduce thebandwidth required to transfer images to the display unit(s) 113. Itwill be recognized that other architectures for generating andtransmitting video data between a remote location of the cameras 1310and the display unit 113 of the present invention are possible; theforegoing embodiments are merely illustrative of two of sucharchitectures.

Referring again to FIG. 11, the monitoring and security sub-system 1100described above also optionally provides for the display of data frommotion detectors 1140 mounted in the vicinity of the elevator doors1106, yet out of the field of view of the video cameras 1102, 1310. Awell known tactic of criminals is to wait in poorly lighted areasadjacent to elevators in order to ambush unsuspecting victims emergingfrom the elevator once the doors are closed. In lieu of multiple videocameras 1102, motion detectors 1140 (such as those of the ultrasonictype) or alternatively, infrared radiation detectors 1150 may be mountedin such areas to apprise the occupants of the elevator that a person islikely present in an area adjacent to the elevator doors on a givenfloor. This information is displayed to the user within the elevatorusing any number of display formats, such as a light emitting diode, orflashing portions of an electronically generated display of the floor ofinterest corresponding to the locations of the detector(s), as shown inFIG. 12.

In addition to the aforementioned “early warning” features, the presentinvention also optionally includes the capability by which the user canselect the specific location on the floor of interest to which they willbe traveling from inside the elevator car, thereby enabling additionallighting, video surveillance, or other features. In one embodiment,shown in FIG. 14 a, a video or graphic representation 1402 of the floorselected by the user is generated and displayed on the display unit 113of the information system 100. Specifically, the floor display 1402 isinitiated after the user depresses a dedicated function key (forexample, a “Safety” function key on the keypad 116, or “soft” key on thetouch screen 113; not shown) followed by the floor number ordesignation. The user then inputs the destination to which they will betravelling on that floor by touching a corresponding area of the touchscreen 113. This input is converted to coordinates within the floor byan algorithm running on the processor 106 (FIG. 1), which are thencorrelated by the processor 106 to one or more of several zones 1404within the floor lighting system and/or security video monitoringsystems present within the building. This lighting and video monitoringequipment is then selectively activated for the zone(s) between theelevator doors and the destination, thereby providing enhancedvisibility for the user during their travel, and also video monitoringby the building's centralized security facility 1125. Lighting and videomonitoring is activated through a micro-controller 123 and associatedcontrol circuitry 1412 connected to the keypad 116 as shown in FIG. 1,although other configurations may be used. An audio or visual alarm 1414is actuated in the security facility 1125 to alert security personnel ofthe activation of the video monitoring function for that floor/zone,thereby drawing their attention thereto. Alternatively, in anotherembodiment, the signal from the remote video equipment is routed to thesystem 100 and display 113 within the elevator car 180, thereby allowingthe occupant to monitor the areas which they will be traversing. In suchembodiment, the video presented on the display panel screen is segmentedinto multiple parallel “windows”, such as into four segments 1420 a-dcorresponding to four video cameras located between the elevator car andthe selected destination on the floor of interest as shown in FIG. 14 b.

The operation of the foregoing functions is best illustrated by theexample of a parking garage in the basement of an office building, inwhich a user has parked during late night hours. Such garages typicallyare located on the ground level or basement of the building and are opento pedestrian access, thereby making them more accessible to criminals.During late night or weekend hours, these garages are also oftendeserted. When the user enters the elevator car 180 on a higher floorwithin the building, they first select the floor number to which theydesire to travel, in this case the garage (“G”) level. The user may thendepress the “Video” function key 1110 followed by the “G” key on thekeypad 116 (or touch screen 113) to monitor the video camera output atthe door of the elevator 1106 on the garage level, as well as any motionor IR sensors 1140, 1150 located thereabouts. Assuming no indications ofdanger are present, the user then depresses the “Safety” function key1111, which displays a map or plan view 1402 of the floor selected inrelation to the elevator doors 1106. The user then touches the map 1402in the general area where their car is parked, which activates thelighting in the zones between the elevator doors and the selectedlocation if not already activated, and initiates a direct video feed tothe building security office 1125 (or other desired location) from thevideo cameras 1102, 1310 covering those zones. These functions may beput on a timer or controlled by another input (such as the timeout of amotion sensor 1140 in the area) such that the monitoring functions areceased at an appropriate time or upon the occurrence of a desired event.The system may also be programmed to handle multiple zones on the samefloor (such as when multiple passengers on the elevator car 180 areparked on the same level), or multiple zones on different floors.

Identification and Access Sub-System

Referring now to FIGS. 15 and 16, the occupant identification and accesssub-system 1500 of the present invention is described. As shown in FIG.15, the identification and access sub-system 1500 generally comprises anRFID tag 1502, reader 1504, and access database 1510 of the type wellknown in the art, which uniquely and automatically identifies occupantsof the elevator, and provides them access to certain restricted floors.In one embodiment, the RFID tag 1502 of the present inventionauthenticates the tag reader 1504 of the access sub-system 1500 suchthat when the tag 1502 is interrogated by the reader 1504 (such as whenthe user steps into the elevator car 180), an appropriate code orpassword must be provided within the RF signal from the reader for thetag 1502 to radiate its RF identification signal. See FIG. 16. In thisfashion, unauthorized access to the RF signature or emissions of the tag1502 through use of an unauthorized reader are frustrated. However, thistechnique can potentially be defeated through the coincident monitoringof the tag's emissions at close range when interrogated by an authorizedreader 1504, and subsequent replication of the monitored emissions fromthe tag 1502 to the authorized reader 1504. Accordingly, in conjunctionwith the aforementioned reader authentication process, the RFID tag 1502and reader 1504 of the present invention also optionally utilize anencrypted data protocol, such that any transmissions from the tag 1502are encrypted, and accordingly must be decrypted by the authorizedreader 1504 before the access database 1510 is searched. In oneembodiment, the RFID tag 1502 and reader 1504 comprise a direct sequencespread spectrum (DSSS) communication system incorporating a PN(pseudo-noise) spreading code of the type well known in thecommunications art. In another embodiment, a frequency hopping spreadspectrum (FHSS) having a hopping sequence is used to enhance security.The use of passwords, encrypted data protocols, and spread spectrumtechniques for security is well known in the art, and accordingly willnot be described further herein. See U.S. Pat. No. 5,539,775 entitled“Modulated spread spectrum in RF identification systems method” issuedJul. 23, 1996, and U.S. Pat. No. 5,629,981 entitled “Informationmanagement and security system” issued May 13, 1997, both incorporatedherein by reference in their entirety.

In the embodiment of FIG. 15, an RFID interrogator/reader 1504 is placedwithin the walls of the elevator car 180. The reader 1504 has limitedrange and is directional in nature such that it will not interfere withthe readers of other elevator cars nearby or other RF devices. Thereader 1504 interrogates the passengers of the car based on sensingtheir presence, such as by (i) the user depressing the elevator callbutton and the doors being provided an “open” signal by the controlsystem; or alternatively (ii) by sensing pressure on the one or morepiezoelectric sensors 806 present within the flooring of the car asshown in FIGS. 8-9 above. As will be recognized by those of ordinaryskill in the art, myriad different schemes for activation of the reader1504 are possible, all being contemplated for use with the inventiondisclosed herein. As shown in FIGS. 15 and 16, the reader interrogatesany RFID tags 1502 in the possession of the car occupants, which in turnrespond by emitting RF energy at a particular frequency when properauthentication of the reader occurs. The RFID tags 1502 of the presentinvention are advantageously embedded within a thin profile access card1506 for ease of carrying by the user, although other configurations maybe used. The RF signal(s) received by the reader 1504 are then comparedby the processor 106 to a list of known or authorized entrants and theiraccessible locations residing within a database 1510 stored on the fileserver 170 or locally on the storage device 108, 110 in order to findthe entry or entries corresponding thereto. At this point, any matchingentries found cause the processor 106 to signal a micro-controller 1513to initiate a call signal to the control logic 1507 for a specific flooror floors authorized for access during after-hours operation per thedata file 1510, subject to proper password entry by the user. The useris then required to authenticate using a password input via the inputdevice 102 or touch screen 113 located inside elevator 180.Alternatively, one or more recessed or view-obstructed alpha-numerickeypads (not shown) are disposed within the elevator car to permit theuser to enter their password without it being seen by other occupants.

In the event that multiple RFID tags 1502 are present on the car 180,yet multiple occupants carrying such tags wish to go to a singlelocation (such as if one person with authorization for access to floor“A” is accompanying persons with authorization for other floors only),the other tag holders need only not authenticate the non-desired floors,at which point the system will refuse access to those floors, and notgenerate a call signal via the micro-controller 1513. Hence, people mayonly egress the elevator on the authenticated floor(s), or the lobby.

Additionally, the access sub-system 1500 can optionally notify security(and/or the destination floor) of the user's destination and identity,and maintain a record of access. Such notification may be useful formonitoring the location of individuals within the building, and/oradvance warning of the arrival of a particular person. Furthermore, suchsecurity records can be used to archive the history of access toparticular areas during certain periods of time. The records may bemaintained on a remote central server 170, or locally within the accesssystem 1500 itself.

The user may also optionally perform other functions such as lightingand environmental control from the elevator car 180 using the accesssub-system 1500. Specifically, in one embodiment, the authenticated useris provided a display 1700 with several predetermined function keys1702, 1704 disposed thereon, as shown in FIG. 17. The functionsassociated with the keys include, for example, initiation or terminationof lighting or HVAC in various areas of the destination floor. Thedisplay may comprise a set of function keys 1702, 1704 on a keypad 116as described above, or alternatively comprise a graphic display on thetouch screen 113. Many other display formats and techniques, such as“soft” function keys on the keypad 116, which allow multiple functionsper key depending on operating mode, are possible. Using the accesssub-system 1500, the user may selectively start remote equipment such aslighting and/or HVAC on the authenticated floor in advance of theirarrival, and all from a single convenient location. Additionally, theRFID tag 1502 for a given user may be encoded with informationindicating the location of the user's individual office or work area.Hence, when the user is authenticated and selects either the HVAC orlighting initiation functions, these services are only activated in alimited portion or certain zones of the floor, thereby saving on energycosts. If the user desires, he/she may initiate the foregoing servicesfor their entire suite or floor (subject to authorization) by depressingthe “Global” function keys 1714 on the keypad before selecting theservice.

Lastly, the user may also use their RFID tag 1502 to permit theinformation and control system 100 of the present invention topre-configure the PED download function described above upon receipt ofan authenticated RFID signal. Specifically, the access sub-system 1500“remembers” each individual user's selected download configuration bystoring a data file at an address on the storage device 108, 110 orserver 170 referenced within the aforementioned security access database1510. As described above, each time the tag 1502 authenticates thereader 1504 and the tag emits it's RFID signal (which is subsequentlydecrypted by the reader 1504), the access control sub-system 1500attempts to match the user's ID to one located within the accessdatabase 1510. Upon a successful match, the access sub-system 1500 alsoretrieves the download configuration file from the address referenced inthe database 1510 associated with that user ID, and stores it in localmemory or storage 110, 108. Upon user authentication with theappropriate password via the input device 102, the information andcontrol system 100 transfers the download configuration file from memory110, 108, whereby the user may receive the pre-configured downloadsimply by inserting their PED 704 into the data terminal 702 associatedwith the authenticating input device 102. Note that when multiple userswith distinct RFID tags 1502 are present in the elevator car, thesub-system 1500 only transfers the download configuration file to thecontrol system 100 for those users completing password authentication,and then only to the data download terminal 702 associated with theauthenticating input device 102. Hence, multiple people within theelevator car 180 may authenticate and download data simultaneously, ifdesired (assuming that the elevator car is equipped with multiple datadownload terminal/input device pairs).

Adaptive Advertising Sub-System

Referring now to FIGS. 1 and 18 a-d, the adaptive advertising sub-systemof the information and control system 100 is described. Using thisadvertising sub-system, the aforementioned elevator display devices 113and information and control system 100 may be programmed to provideadaptive advertising or information. As shown in FIG. 1, the advertisingsub-system 1800 is comprised of components resident within theinformation and control system 100, as well as data files and anadaptive algorithm (not shown) running on the processor 106.Specifically, the speech recognition module 104, DSP 125, processor 106,and other related components previously described recognize speech andconvert this speech into a digital representation. These digitalrepresentations are analyzed by the adaptive algorithm in one of twoadaptive modes: 1) prompt mode, and 2) statistical mode, as describedbelow.

In prompt mode, the speech of one or more passengers on the elevator car180 is sampled and analyzed in real time to determine the general topicof conversation between the passengers. FIG. 18 a illustrates thelogical flow of the prompt mode process. Specifically, the processor 106(FIG. 1) accesses a stored data file or library of sub-files of keywordsstored on the remote server 170 or local storage device 108 which relateto certain topics of interest. The library 1840 (FIG. 18 b) ideally doesnot contain common words such as conjunctions, prepositions, or thelike, but rather unique and preferably multi-syllabic words which arenot generic to many different topics. For example, the words“deposition” or “litigation” may be used as keywords indicating thepresence of a member of the legal profession. The predefined library1840 of keywords arranged into sub-files 1842 is present on the server170 or storage device 108; this library 1840 may be based on knowledgeof the building's tenants, on some demographic factor common to peoplewho most often use the elevator, or other factors. As illustration, theforegoing library sub-file 1842 consisting of, inter alia, the terms“deposition” and “litigation” would be appropriate for an applicationwhich is frequented by attorneys or paralegals. When the speechrecognition module 104 compares and matches these library terms with theactual speech of the occupants of the car, a binary value indicative ofthe matched library sub-file 1842 is generated. Note that thesesub-files 1842 are not physically separate files in the presentembodiment, but rather “virtual” files that relate to theirorganizational commonality. Specifically, each library word 1843 orentry includes several consecutive bits (such as an 8-bit data word 1844in the present embodiment) appended on the beginning or end of thedigital file data 1846 which indicate the sub-file(s) with which theword is associated. When a digital representation of a word within thelibrary 1840 is matched, the data word 1844 appended thereto is used asan address for advertising image data (and/or CELP audio data) held inthe storage device 108 or server 170. As a simple example, when theadvertising sub-system matches the digitized form of the spoken word“litigation” to an entry within the library file, the 8-bit wordappended to that entry of the library file is used to address the imageand/or audio data file(s) relating to legal topics stored on the localstorage device 108 (or server 170). This “legal” image data may contain,for example, a representation of an advertisement for legal documentservices, or a talking advertisement for a law firm. The image data fileis then retrieved and displayed on the display screen 113 using anynumber of well known graphic display techniques. The CELP or otherformat audio file is decompressed and converted to an analogrepresentation using the speech synthesis module 112 (FIG. 1) andamplified over the speakers 111 in the elevator car 180 if desired.

The system is further configured such that if multiple image data filesare requested by the processor 106, such as may occur when two differentsets of people within the elevator car 180 are discussing two unrelatedtopics, each different image data file is allocated to a differentavailable display 113 within the elevator car. For audio, only one datafile is converted and played at any given time to avoid confusion.Furthermore, the sampling rate of the system may be set at a lowfrequency, such as once every 60 seconds, or only when the givenelevator car 180 is in operation, so that a given image is maintainedfor an appropriate period of time on the displays 113.

In the event that a word is recognized by the advertising sub-systemwhich includes two or more sub-file address references (such as for theword “trademark”, which may have connotations relating to bothintellectual property law and business), the sub-system allocates eachof the ambiguous references to a separate display (up to the existingnumber of unused displays 113 at that time), and then attempts toresolve the ambiguity by waiting for the next word which is matchedwithin one of the sub-files 1842 (FIG. 18 b) whose designation isappended on the library entry 1843 for the first word. If that nextmatched word does not resolve the ambiguity, the process is repeateduntil the ambiguity is resolved. During ambiguity resolution, theexisting file displayed on each display screen 113 is maintained for theduration of the process, thereby providing an apparently seamlessdisplay to the occupants of the car.

In an alternate embodiment of the “prompt” mode (FIG. 18 c), the systemaccesses the building directory file discussed previously with respectto FIGS. 1-4 using the floors selected by the user to obtain pertinentadvertising information. Specifically, when a passenger riding on thecar 180 selects a floor via the floor selection panel (not shown), oralternatively calls the elevator from a given floor, the system accessesthe building directory file to obtain information regarding the tenantson that floor. The building directory file for each tenant includes anappended data word which uniquely identifies the business area or otherdescriptive information about the tenant. For example, an intellectualproperty law firm residing on the fourteenth floor of a building wouldhave an appropriate code, as represented by a multi-bit data word,indicating that they were engaged in the in (i) legal practice, and (ii)intellectual property as a sub-specialization. Whenever the fourteenthfloor was selected within the elevator car 180, or alternativelywhenever an elevator call was made from the fourteenth floor andanswered, the system would display advertising images, video, or textmessages relating to the field of intellectual property law within thecalling/answering car until or beginning when the fourteenth floor wasreached, respectively. If multiple floors were selected within the car,as is commonly the case, the sub-system would prioritize the messagesdisplayed based on the direction of travel of the car and it's proximityto a given floor. The system also optionally estimates the remainingtime until the floor is reached as part of its analysis.

As an example of the alternative embodiment of FIG. 18 c, if four peopleenter the same elevator car at the lobby level, and each depress adifferent floor number (say the third, seventh, eighth, and eleventhfloors), the sub-system 1800 would prioritize the first floor to beencountered (i.e., the third floor) in its direction of travel anddisplay advertising pertinent to the tenant on that floor. Since thetravel time between the lobby (first floor) and third floor would beonly perhaps 10 seconds, the sub-system 1800 would choose advertisingappropriate to that time slot, such as a fixed image. Once the carreached the third floor and the doors opened, the sub-system 1800 thenprioritizes the next floor to be encountered (here, the seventh floor).Accessing the building directory file for the seventh floor, thesub-system 1800 would then choose advertising appropriate that floor andthe remaining time available (perhaps 15 seconds). After the seventhfloor was reached, the sub-system 1800 would then prioritize the eighthfloor. If the time interval to the next floor was too short asdetermined by a predetermined parameter, such as a minimum time intervalin seconds, the sub-system would prioritize the next floor whose timeinterval exceeded the minimum (in this case, the eleventh floor). Whenall passengers were unloaded, the car 180 would remain at the lastselected floor (eleventh) until another call was initiated. When thisnew call was received, the sub-system 1800 would retrieve advertisingrelevant to the floor from which the new call was initiated, and displaythat information once the floor was reached by the car 180 (asdetermined by a position sensor, the opening of the doors, or any otherwell known means). It is apparent that under very crowded conditionswhere many often closely situated floors are selected by the occupantsof the car, the sub-system 1800 may encounter few instances where theestimated time of travel of the car exceeds the aforementioned minimumparameter value. In such cases, the sub-system 1800 may be made torevert to “prompt” mode audio sampling as described above (FIG. 18 a),or some other alternative scheme for selecting pertinent advertising.Many different variations of the basic approach described herein arepossible, all of which are considered to be within the scope of theinvention.

In the case of multiple tenants residing on one floor, the sub-system1800 can be programmed to display images pertinent to each tenant on thefloor based on a selection routine. In one embodiment, if multipleunrelated tenants occupy a given floor, and that floor is selected by aperson entering the elevator at the lobby, the sub-system 1800 will pickimage data relating to the different tenants on a rotating basis suchthat each subsequent time that same floor is selected, an imageappropriate to a different tenant will be retrieved and displayed.Alternatively, the selection may be made random, or even be coupled tothe speech recognition module 104 to weight one choice over theother(s). Many other arrangements are possible, all of which areconsidered to be within the scope of the invention disclosed herein.

Referring now to FIG. 18 d, the so-called “statistical” mode of theadaptive advertising sub-system 1800 is now described. During operationin statistical mode, the sub-system 1800 gathers statistics on thespeech patterns of its occupants over a predetermined (or open ended)period of time, in order to derive statistics on the most frequentlyencountered words within its library. Using prior examples, if a givenbuilding has a substantial population of law firms, the speechrecognition system 104 may encounter legally-related words or sub-filespresent in its library 1840 (such as “deposition” or “litigation”) mostoften. The system of the present invention effectively builds histogramsfor each of the words in its library 1840 over the sampling period, andstructures its advertising accordingly. Specifically, as shown in FIG.18 d, the statistical mode algorithm running on the processor 106 ofFIG. 1 increments a statistical data file on the storage device 108,110, server 170, or other location. The sub-system 1800 samples thisdata file at a predetermined periodicity (such as every hour, every 24hours, or every update cycle of the advertising display) to determinethe distribution of occurrences of each word. This distribution is thencompared to a historical data file which represents the number ofinstances advertising associated with each sub-file has been displayed.Advertising data files are then selected and displayed by the processor106 and algorithm such that the desired proportionality between thesampled statistic and the display sequence is maintained. Returningagain to the foregoing example, if words relating to the “legal”sub-file constituted 20% of the matches in the sampled data over a givenperiod, then legally-related advertising would be displayed by theadvertising sub-system approximately 20% of the time.

It is noted that the aforementioned speech-related adaptive advertisingmodes (FIGS. 18 a, 18 c, and 18 d) may be automatically disabled whenthe speech recognition module 104 is in use or required by anotherfunction within the information and control system 100. For example,when the previously described “Building Directory” function key 122 isdepressed, the prompt and statistical advertising modes are interruptedor frozen by the processor 106 until the selected function is terminatedeither manually by the user or via the expiration of a system clock(i.e., the function “times out”). This interrupt allows the buildingdirectory function to operate unimpeded without having to shareresources within the information and control system 100 with theadaptive advertising sub-system 1800. It will be recognized, however,that the information and control system 100 may so configured to allowsuch parallel operation if desired.

Alternatively, the aforementioned network interface 300 of FIG. 3 may beused as an input to the adaptive advertising sub-system 1800. As iscommonly used with prior art Internet browsers, adaptive “banners”display advertising related to a user's query on a search engine. In thepresent invention, the advertising graphics presented on the display 113may either be anecdotally or statistically adaptive to the user'sinformation queries. Specifically, in one embodiment of the anecdotalsystem (FIG. 19), user inputs received via the input devices 102 ortouch screens 113 are provided to an adaptive algorithm which identifieseach query type as falling within one or more predetermined categories.As the user selects a given function key 114, a code unique to thatfunction key is also generated. The advertising data files, each havinga “tag” (such as a code or data bits embedded or appended to the addressin memory) are then searched by the algorithm to match those fileshaving the same category tag. These files are then retrieved from thestorage device 108, 110, or server 170 in a predetermined order (such assequence based on ascending address locations, or some other parameter),and displayed on the display device 113. The display of these files maybe in sequential fashion, each for a predetermined interval, oralternatively one file may be displayed until another function key 114is selected. Many other display schemes are possible, consistent withthe invention.

As an example of anecdotal adaptation, consider the case where the userselects the “Weather” function key on the keypad 116 (or touch screen113). The sub-system 1800 retrieves and displays the desired weatherinformation on the display device, while also retrieving and displayingadvertising graphics relating to weather (such as for a local televisionstation's weather reports) on an advertising placard or banner on thesame or another display. If the user then selects another function key114, the sub-system 1800 retrieves another advertising graphic filerelating to the newly chosen function.

In a statistical adaptation, the choice of function keys 114 by eachsuccessive user adds to a data file which is generated by a statisticalalgorithm running on the processor 106. The algorithm calculates andstores a running total of the number of times each function key 114 (oreach functional category) is selected over a predetermined period.Advertising graphics are displayed on the display unit(s) 113 inproportion to this statistic. For example, if the “Weather” function keywere actuated five times as often as the “Stock Quotes” key over a giveninterval, the sub-system 1800 could be programmed to retrieve anddisplay weather-related advertising on average five times as often asfinancial advertising

Note that the foregoing anecdotal and statistical adaptation embodimentsmay also be used together. For example, the sub-system 1800 could beprogrammed to display advertising on a statistical basis during periodsof non-use, while displaying advertising anecdotally during use. Manyother variants are also possible.

It is noted that while various aspects of the invention disclosed hereinare described in terms of specific embodiments (and logic diagrams) ofmethods and processes, other embodiments of these methods and processesare possible consistent with the invention. For example, certain stepsin the disclosed methods may be deleted, and/or additional steps added.Furthermore, the order of performance of steps may in many cases bepermuted, or multiple steps disclosed as being performed in series maybe performed in parallel, and vice versa. The embodiments disclosedherein are therefore considered merely illustrative of the broadermethods claimed herein.

While the above detailed description has shown, described, and pointedout the fundamental novel features of the invention as applied tovarious embodiments, it will be understood that various omissions,substitutions, and changes in the form and details of the device orprocess illustrated may be made by those skilled in the art withoutdeparting from the spirit of the invention.

What is claimed is: 1.-40. (canceled)
 41. Computerized information anddisplay apparatus, comprising: a wireless network interface; processingapparatus in data communication with the network interface; speechprocessing apparatus in data communication with the processingapparatus; speech synthesis apparatus in data communication with theprocessing apparatus; an input device in communication with theprocessing apparatus and configured to, when actuated, cause thecomputerized information and display apparatus to enter a mode whereby auser can provide a speech input to the speech processing apparatus; adisplay device viewable by the user while providing the speech input;video data apparatus in data communication with the processing apparatusand the display device and configured to enable digital video data to bedisplayed on the display device; and a storage apparatus comprising atleast one computer program in data communication with at least theprocessing apparatus; wherein said computerized information and displayapparatus is configured to: after entry into the mode, obtain digitizedspeech from the speech processing apparatus, the digitized speechgenerated based on the speech input received from the user, the receivedspeech input comprising at least part of a name of a business entity;cause, based at least in part on the digitized speech, identification ofa match to the at least part of the name; cause retrieval of contentassociated with the match from a remote network entity via the wirelessnetwork interface; and display the content associated with the match onthe display device, the content aiding the user in finding the businessentity, the content comprising at least an image showing a location ofthe business entity and at least its immediate surroundings.
 42. Thecomputerized information and display apparatus of claim 41, wherein thecomputerized information and display apparatus is integral with anapparatus configured to transport multiple persons, and the digitalvideo data is generated by a plurality of cameras in data communicationwith the computerized information and display apparatus and displayed onthe display device in corresponding ones of portions of the displaydevice so as to enable simultaneous monitoring of multiple portions ofan area proximate an exterior of the apparatus configured to transport.43. The computerized information and display apparatus of claim 41,wherein the computerized information and display apparatus is integralwith an apparatus configured to transport multiple persons, and thecomputerized information and display apparatus further comprises atleast one motion detection apparatus configured to alert the user ofmotion occurring outside of the a passenger compartment of the apparatusconfigured to transport.
 44. The computerized information and displayapparatus of claim 41, wherein the computerized information and displayapparatus is integral with an apparatus configured to transport multiplepersons, and the computerized information and display apparatus furthercomprises at least one motion detector configured to alert the user ofmotion occurring outside of the apparatus configured to transport, thealert comprising display of visually perceptible information on thedisplay device.
 45. The computerized information and display apparatusof claim 41, wherein the image showing the location of the businessentity and at least its immediate surroundings further shows one or moreother entities immediately proximate to the location, so as tofacilitate the user orienting themselves as they approach the businessentity.
 46. The computerized information and display apparatus of claim41, wherein the computerized information and display apparatus isconfigured to prompt the user to provide the speech input, the promptcomprising a synthesized voice prompt requesting the user to provide thespeech input.
 47. The computerized information and display apparatus ofclaim 41, wherein the causation of identification of the matchcomprises: identifying a plurality of possible matches to the at leastpart of the name; presenting at least a portion of the plurality ofpossible matches to the user; receiving a subsequent user speech inputidentifying one of the at least portion of the plurality of matcheswhich the user desires; and wherein the display of the contentassociated with the match on the display device comprises display of thecontent associated with the identified one of the at least portion ofthe plurality of matches which the user desires.
 48. The computerizedinformation and display apparatus of claim 47, wherein the computerizedinformation and display apparatus is further configured to revert to amode where the user cannot enter the speech input after a prescribedperiod of time expires without the user providing the speech input,unless the input device is again actuated.
 49. The computerizedinformation and display apparatus of claim 41, wherein the computerizedinformation and display apparatus is further configured to provide atleast a portion of information obtained via the network interface inresponse to a speech query of the user to a portable electronic devicevia a data interface of the computerized information and displayapparatus.
 50. The computerized information and display apparatus ofclaim 49, wherein the computerized information and display apparatus issubstantially integral with an apparatus configured to transportmultiple persons, and the at least portion of information obtained viathe network interface comprises at least map data relating to an arealocal to the apparatus configured to transport.
 51. The computerizedinformation and display apparatus of claim 50, wherein the datainterface comprises an interface utilizing a Universal Serial Bus (USB)protocol and a physical connection between the computerized informationand display apparatus and the portable electronic device.
 52. Thecomputerized information and display apparatus of claim 51, wherein thephysical connection between the computerized information and displayapparatus and the portable electronic device comprises a physicalconnector that is fixedly part of the computerized information anddisplay apparatus and which is at least partly recessed with a slot orenclosure of the apparatus configured to transport multiple persons. 53.The computerized information and display apparatus of claim 50, whereinthe computerized information and display apparatus is configured suchthat provision of at least a portion of information obtained via thenetwork interface in response to a speech query of the user to aportable electronic device via a data interface can be invoked byapplication software present on the portable electronic device, theapplication software present on the portable electronic deviceconfigured to receive and store the at least portion of information forsubsequent use by the user in navigating an area local to the apparatusconfigured to transport.
 54. The computerized information and displayapparatus of claim 41, wherein the wireless network interface comprisesa wireless interface compliant with an IEEE 802.11 WLAN standard. 55.The computerized information and display apparatus of claim 41, whereinthe computerized information and display apparatus is further configuredto display a plurality of icons corresponding to respective ones oftopical areas, selection of the topical areas by the user causing accessof an Internet entity via at least the wireless network interface inorder to retrieve information relevant to the user and relating to theselected topical area.
 56. The computerized information and displayapparatus of claim 55, wherein the topical areas include weatherinformation, and the information relevant to the user comprises aweather forecast for a prescribed geographic area, the area selected bythe user via the computerized information and display apparatus.
 57. Thecomputerized information and display apparatus of claim 55, wherein theicons are selected to facilitate rapid access to and display of alimited collection of data in order to reduce the amount of time neededby the user to locate and be cognitive of information that the userdesires to a few seconds.
 58. The computerized information and displayapparatus of claim 57, wherein the display device comprises atouch-screen input and display device, and the topical areas areselectable by the user via touching the screen of the touch screen inputand display device in a region of an icon corresponding with arespective one of the topical areas.
 59. The computerized informationand display apparatus of claim 55, wherein the display device comprisesa touch-screen input and display device, and the topical areas areselectable by the user via touching the screen of the touch screen inputand display device in a region of an icon corresponding with arespective one of the topical areas.
 60. The computerized informationand display apparatus of claim 41, wherein the computerized informationand display apparatus is substantially integral with an apparatusconfigured to transport one or more persons between various locations,and the information and display apparatus further comprises: a touchinput device configured to allow the user to provide input to theinformation and display apparatus by touching a touch-sensitive portionof the touch input device, the touch input device not having a displayscreen; and at least one of (i) ultrasonic sensing apparatus in datacommunication with at least a portion of the processing apparatus andconfigured to detect at least motion external to the apparatusconfigured to transport, and provide the user an alert relating thereto;and/or (ii) infrared sensing apparatus configured to detect the presenceof at least a human external to the apparatus configured to transport,and provide the user with an indication thereof.
 61. The computerizedinformation and display apparatus of claim 60, wherein the computerizedinformation and display apparatus is further configured to revert to amode where the user cannot enter the speech input after a prescribedperiod of time expires without the user providing the speech input,unless the input device is again actuated.
 62. The computerizedinformation and display apparatus of claim 41, wherein the computerizedinformation and display apparatus is further configured to transfer aplurality of data to a portable electronic device via a data interfaceof the computerized information and display apparatus, the datainterface comprising an interface utilizing a Universal Serial Bus (USB)protocol and a physical connection between the computerized informationand display apparatus and the portable electronic device.
 63. Thecomputerized information and display apparatus of claim 62, wherein theplurality of data transferred comprises data having been configured atleast in part based on a plurality of inputs previously provided by theuser, the inputs previously provided by the user to the computerizedinformation and display apparatus.
 64. The computerized information anddisplay apparatus of claim 62, wherein the information system furthercomprises a short-range wireless interface configured to obtain datafrom a portable user radio frequency device when the portable user radiofrequency device is within sufficient range of the short-rangeinterface, the information configured to use the obtained data so as toconfigure one or more functions of the computerized informationapparatus according to a previously supplied user preference or profile.65. The computerized information and display apparatus of claim 41,further comprising a short-range wireless interface configured to obtaindata from a portable user radio frequency device when the portable userradio frequency device is within sufficient range of the short-rangeinterface, the information configured to use the obtained data so as toconfigure one or more functions of the computerized informationapparatus according to a previously supplied user preference or profile.66. The computerized information and display apparatus of claim 41,further comprising a short-range wireless interface configured to obtaindata from a portable user radio frequency device when the portable userradio frequency device is within sufficient range of the short-rangeinterface, the information system configured to use the obtained data soas to selectively enable only a portion of a plurality of functions ofthe computerized information system according to a pre-existing profileor preference associated with the user.
 67. The computerized informationand display apparatus of claim 41, wherein the computerized informationand display apparatus is substantially integral with an apparatusconfigured to transport multiple persons, and further comprises at leastone sensing apparatus in data communication with at least the processingapparatus and configured to sense occupancy of the transport apparatus.68. The computerized information and display apparatus of claim 67,wherein the at least one sensing apparatus comprises a plurality ofpressure sensors configured to sense a force applied thereto, the forcegenerated by the weight of a person, and wherein the sensing of theoccupancy of the transport apparatus comprises determining a number ofpersons within the transport apparatus based at least in part on one ormore of the sensors indicating that a force is being applied theretocorresponding to a person.
 69. The computerized information and displayapparatus of claim 67, wherein the at least one sensing apparatuscomprises a plurality of pressure sensors configured to determine that aforce is being applied thereto, and computerized logic configured todetermine said occupancy by counting a number of occupants based onoutputs from said plurality of pressure sensors.
 70. The computerizedinformation and display apparatus of claim 41, wherein the digital videodata is generated remotely from the computerized information and displayapparatus, and is received by the computerized information and displayapparatus via at least a wireless interface thereof.
 71. Thecomputerized information and display apparatus of claim 70, wherein thedigital video data comprises data that has been compressed in thedigital domain using an algorithm which compresses data prior totransmission to the computerized information and display apparatus. 72.The computerized information and display apparatus of claim 70, whereinthe remote location comprises a destination to which the user intends totravel.
 73. The computerized information and display apparatus of claim41, further comprising voice communication apparatus, the voicecommunication apparatus enabling the user to contact a monitoringstation or service remotely disposed from the user, the contact to causethe monitoring station or service to invoke one or more securityfeatures relevant to at least one of: (i) a current location of theuser, and/or (ii) a future destination of the user.
 74. The computerizedinformation and display apparatus of claim 72, wherein the one or moresecurity features comprise at least one of (i) additional lighting,and/or (ii) monitoring via a video camera.
 75. The computerizedinformation and display apparatus of claim 41, further configured to:(i) receive via a wireless interface a plurality of images of a remotelocation, the remote location comprising the business entity; and (ii)display the plurality of images substantially simultaneously on thedisplay device, the display of the plurality of images comprisingdisplay of a first of the plurality of images at least partly contiguousto a second of the plurality of images, and a third of the plurality ofimages at least partly contiguous to the second of the plurality ofimages.
 76. The computerized information and display apparatus of claim41, further configured to: (i) receive via a wireless interface aplurality of images of a remote location, the remote location comprisingthe business entity, the plurality of images comprising imagescorresponding to respective ones of portions of the location, theportions being at least partly contiguous with others of the portions atthe location; and (ii) display the plurality of images substantiallysimultaneously on the display device.
 77. The computerized informationand display apparatus of claim 76, wherein the plurality of images areeach derived from a camera that visually observed the respective one ofthe portion of the location.
 78. The computerized information anddisplay apparatus of claim 41, further configured to selectively adjustlighting associated with at least a portion of a path of travel of theuser as a safety precaution.
 79. The computerized information anddisplay apparatus of claim 78, wherein the selective adjustment oflighting as a safety precaution comprises increasing at least one of theintensity or number of lights activated in order to enhance uservisibility, the enhanced visibility enabling the user to better avoidone or more hazards.
 80. Computerized information and display apparatus,comprising: a wireless network interface; processing apparatus in datacommunication with the network interface; speech processing apparatus indata communication with the processing apparatus; speech synthesisapparatus in data communication with the processing apparatus; an inputdevice in communication with the processing apparatus and configured to,when actuated, cause the computerized information and display apparatusto enter a mode whereby a user can provide a speech input to the speechprocessing apparatus; a display device viewable by the user whileproviding the speech input; video data apparatus in data communicationwith the processing apparatus and the display device; sensor apparatusin data communication with the computerized information and displayapparatus; and a storage apparatus comprising at least one computerprogram in data communication with at least the processing apparatus;wherein said computerized information and display apparatus isconfigured to provide information derived from multiple sources to theuser by at least: (1) receiving, upon actuation of the input device bythe user, a signal from the input device; based at least on the signal,entering the mode; obtaining digitized speech from the speech processingapparatus, the digitized speech generated based on the speech inputreceived from the user, the received speech input comprising at leastpart of a name of a business entity; causing, based at least in part onthe digitized speech, identification of a match to the at least part ofthe name; causing retrieval of content associated with the match from aremote network entity via the wireless network interface; and displayingthe content associated with the match on the display device, the contentaiding the user in finding the business entity, the content comprisingat least an image showing a location of the business entity and at leastits immediate surroundings; (2) receiving data from the sensorapparatus; and generating, based at least on the received data, at leastone of an audible and/or visual alert, the at least one alert relatingto at least one of: (i) motion sensed by the sensor apparatus; and/or(ii) infrared radiation corresponding to a living being detected by thesensor apparatus; and (3) receiving digital video data from the videodata apparatus, the digital video data generated based on video signalsobtained from at least one camera apparatus; and displaying the receiveddigital video data on the display device.
 81. The computerizedinformation and display apparatus of claim 80, wherein the at least onecamera apparatus comprises a plurality of camera apparatus disposed soas to view a plurality of different areas, and the displaying thedigital video data on the display device comprises displaying video dataderived from respective ones of the plurality of the camera apparatus onrespective ones of substantially contiguous display regions on thedisplay device such that the user can substantially simultaneously vieweach of the video data on the display device.
 82. The computerizedinformation and display apparatus of claim 81, wherein each of theplurality of different areas are substantially contiguous with at leasta portion of at least one other of the plurality of different areas. 83.The computerized information and display apparatus of claim 80, whereinthe sensor apparatus comprises at least one infrared radiation detector,the at least one alert relates to infrared radiation corresponding to aliving being detected by the at least one infrared detector, and the atleast one alert comprises a visual alert, the visual alert comprising alight-modulated indication.
 84. The computerized information and displayapparatus of claim 83, wherein the light-modulated indication comprisesa flashing or blinking indication rendered on the display device. 85.The computerized information and display apparatus of claim 80, furthercomprising voice communication apparatus, the voice communicationapparatus enabling the user to contact a monitoring station or serviceremotely disposed from the user via the wireless network interface, thecontact to cause the monitoring station or service to invoke one or moresecurity features relevant to at least one of: (i) a current location ofthe user, and/or (ii) a future destination of the user.
 86. Thecomputerized information and display apparatus of claim 80, furtherconfigured to: (i) receive a user input, the input invoking a functionof the computerized information and display apparatus; (ii) based atleast on the receipt of the user input, transmit data to a remotemonitoring station indicative that the function has been invoked by theuser; and (iii) cause establishment of a voice communication channelwith the remote monitoring station via the wireless network interface.87. The computerized information and display apparatus of claim 80,further configured to: (i) automatically transmit data from computerizedinformation and display apparatus via the wireless network interface toa remote monitoring station, the data indicative that a function of thecomputerized information and display apparatus has been activated, and(ii) enable establishment of a voice communication channel with theremote monitoring station via the wireless network interface.
 88. Thecomputerized information and display apparatus of claim 87, wherein theactivated function comprises a function related to enhancing the safetyor security of the user.
 89. The computerized information and displayapparatus of claim 80, wherein the computerized information and displayapparatus is further configured to permit the user to select adestination of travel, and based at least in part on the selection,enable one or more functions relevant to at least one of (i) thedestination, and/or (ii) a route of travel taken to the destination. 90.The computerized information and display apparatus of claim 89, whereinthe display device comprises a touch screen input and display device,and the selection of a destination of travel comprises selection of aparticular point on a map of an area via the user touching a screen ofthe touch screen input and display device.
 91. The computerizedinformation and display apparatus of claim 90, wherein the computerizedinformation and display device is further configured to: (i) calculatecoordinates for the selected particular point on the map of the area;and (ii) correlate the calculated coordinates to the enabled one or morerelevant functions.
 92. The computerized information and displayapparatus of claim 80, wherein the computerized information and displayapparatus is further configured to permit the user to control at leastone of an HVAC function and/or lighting function associated with abuilding or structure which the user frequents via at least the wirelessnetwork interface of the computerized information and display apparatus.93. The computerized information and display apparatus of claim 92,wherein the display device comprises a touch screen input and displaydevice, and the user control of the at least one of an HVAC functionand/or lighting function associated with a building or structure whichthe user frequents comprises actuation of the at least one function viaone or more soft function keys generated on the display device andselectable by the user via touching a screen of the display device. 94.Computerized information and display apparatus, comprising: dataprocessing apparatus comprising a central processor and at least onedigital signal processor; speech processing apparatus in datacommunication with at least a portion of the data processing apparatus;speech synthesis apparatus in data communication with at least a portionof the data processing apparatus; an input device in communication withat least a portion of the data processing apparatus and configured to,when actuated, cause the computerized information and display apparatusto enter a mode whereby a user can provide a speech input to the speechprocessing apparatus; a display device viewable by the user whileproviding the speech input; video data apparatus in data communicationwith at least a portion of the data processing apparatus and the displaydevice and configured to enable digital video data to be displayed onthe display device, the digital video data generated based on videosignals obtained from at least one camera apparatus; sensor apparatus indata communication with the computerized information and displayapparatus; data storage apparatus in data communication with at least aportion of the data processing apparatus; and a storage apparatuscomprising at least one computer program and in data communication withat least a portion of the data processing apparatus; wherein saidcomputerized information and display apparatus is configured to provideinformation to the user by at least: (1) receiving, upon actuation ofthe input device by the user, a signal from the input device; based atleast on the signal from the input device, entering the mode; obtainingdigitized speech from the speech processing apparatus, the digitizedspeech generated based on the speech input received from the user, thereceived speech input comprising at least part of a name of a businessentity; causing, based at least in part on the digitized speech,identification of a match to the at least part of the name; causingretrieval of content associated with the match from the data storageapparatus; and displaying the content associated with the match on thedisplay device, the content aiding the user in finding the businessentity, the content comprising at least a graphical representationshowing a rendering of a location of the business entity and at leastits immediate surroundings; and (2) receiving data from the sensorapparatus; and generating, based at least on the received data, at leastone of an audible and/or visual alert, the at least one alert relatingto at least one of: (i) motion sensed by the sensor apparatus; and/orinfrared radiation corresponding to a living being detected by thesensor apparatus.